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Indian Standard 

GUIDE FOR 
SENSORY EVALUATION OF FOODS 

PART III STATISTICAL ANALYSIS OF DATA 
Section 1 Difference/Preference Tests 

( First Revision ) 

0. FOREWORD 

0.1 This Indian Standard ( Part lll/Sec 1 ) ( First Revision ) was adopted by 
the Indian Standards Institution on 30 March 1983, after the draft finalized 
by the Sampling Methods for Food Products and Agricultural Inputs 
Sectional Committee had been approved by the Agricultural and Food 
Products Division Council. 

0.2 Sensory evaluation of foods is assuming increasing significance, as this 
provides information which may be utilized for quahty control, assessment 
of process variation, cost reduction, product improvement, new product 
development and market analysis. 

0.3 The sensory evaluation depends on proper panel selection; environ- 
mental conditions and equipment for the test; selection of representative 
sample, its preparation and presentation; terminology; methods employed 
and statistical techniques applied for the analysis of data. In order to 
facilitate easy application and to provide guidelines on the above aspects, 
this standard had been published in three parts. Whereas this part of the 
standard covers the statistical analysis of data, Part I covers the optimum 
requirements and Part II covers the methods and evaluation cards for 
sensory evaluation of foods. 

0.4 This standard (Part III) was originally issued in 1975. While revising 
this standard, the committee decided to split it into two sections, Section 1 
dealing withdiflFerence/preference tests and Section 2 dealing with ranking 
and scoring tests. This standard is being revised so as to bring together 
various tests of the same type having same field of application. The various 
statistical tests are presented in a more simpHfied form so that a common 
user may be able to understand them easily. This revision incorporates the 
preference matrix analysis which is based on the extension of the paired 
comparison test to more than two samples. The sign test has been deleted 
as the same purpose is served by the paired comparison test. 

0.5 The descriptions given in this revision are designed to suit sensory 
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evaluation personnel and more detailed procedures of some of the statistical 
tests are included in IS: 6200 ( Part I)- 1977* and IS: 6200 (Partil)- 

I977f. 

0.6 In the preparation of this standard considerable assistance has 
been derived from ISO 5495-1983 ^Sensoi^ analysis — Methodology — 
Paired comparison test', issued by the International Organization for 
Standardization, 

0.7 In reporting the results of a test or analysis made in accordance with 
this standard, if the final value, observed or calculated, is to be rounded 
off, it shall be done in accordance with IS : 2 - 1960J. 



1. SCOPE 

1.1 This standard (Part Ill/Sec 1) covers difference/preference tests. 
The various tests included in this standard are paired comparison test, duo- 
trio test, triangle test, normal test, preference matrix analysis and x^-test. 

2. TERMINOLOGY 

2.0 For the purpose of this standard, the following definitions in addition 
to the definitions given in IS : 5126 ( Part I ) - 1969§ shall apply. 

2.1 Arithmetic Mean — Sura of the values of the observations divided by 
the number of observations. 

2.2 Critical Difference — The magnitude of difference which will be signi- 
ficant at a chosen level of significance, calculated from the value of the 
standard error of the difference. 

2.3 Degrees of Freedom — The number of independent component values 
which are used to determine a statistic. 

2.4 Error — The difference between observed value and its true or expected 
value. It is not synonymous with mistake. 

2.5 Hypothesis, Alternate — The hypothesis of the difference or non-equi- 
valence between effects of the method(s). The alternate hypothesis may be 
two-sided or one-sided, 

2.6 Hypothesis, NuH — The hypothesis of the equivalence or no difference 
between the effects of the method(s) so that the sample emanates from the 
same population. 



•Statistical tests of significance: Part I /-, Normal and F-tests {first revision ). 

tStatistical tests of significance: Part II X« - test ( first revision ). 

JRules for rounding off numerical values ( revised ). 

IGlossary of general terms for sensory evaluation of foods: Part I Methodology. 
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2.7 Level of Sigmficance — The probability (or risk) of rejecting the null 
hypothesis when it is true. 

2.7.1 Comparison of products is performed with a limited number of 
panelists and a decision has to be projected to the population. As such the 
risk of taking a decision arises which is called level of significance or error 
of the first kind. This is usually fixed at 5 or 1 percent. It follows that a 
decision which is correct at 5 percent level may not be so at 1 percent level. 

2.7.2 Level of significance also represents the chance of not taking a 
correct decision if the experiment were to be repeated a large number of 
times. Significance at 5 percent and 1 percent level means that the chance 
of making a wrong decision is one in 20 and one in 100 respectively. 

2»8 Population ^ The totality of items under consideration. 

2.9 Probability — If a trial results in n possible out-comes which are equally 
likely such that any one of them can occur at a time and out of which m 
cases are favourable to the happening of an event E, the probability of 
event ^ is given by P( £") = m/n, 

2.10 Probability Distribution — The distribution which determines the pro- 
bability that a random variable takes any given value or belongs to a given 
set of values. The probability over the whole interval of variation of the 
variable equals one. 

2.11 Random Variable — A variable which may take any of the values of a 
specified set of values and to which is associated a probability distribution. 

2.12 Range — The difference between the largest and the smallest observed 
values of a measurable characteristic. 

2.13 Replication — The execution of experiment more than once, essentially 
under the same experimental conditions. 

2.14 Statistical Errors 

2.14.1 Error of the First Kind — The error, in concluding that there is a 
difference when in fact there is no difference, resulting in rejection of the 
null hypothesis when it is true, 

2.14.2 Error of the Second Kind — The error, in concluding that there is 
no difference when in fact there is difference, accepting the null hypothesis 
when it is false. 

2.15 Critical Region — The region of possible values of the statistic used 
such that if the value of the statistic which results from the observed values 
belongs to the region> the null hypothesis will be rejected. 

2.16 Test, One-Sided — A test in which the statistic used is unidimensional 
and the critical region is the set of values lower ( or greater ) than a given 
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number. In the case of directional difference tests where the direction of 
difference is known or assumed in advance, a one-sided test has to be used* 

2.17 Test Tffo-Sided — A test in which a statistic used is unidimensional 
and in which a set of values lower than a first given number and the set of 
values greater than a second given number form the critical region, 

2.17.1 Jn preference tests, where the decision can be for any of the tested 
samples and no prior information regarding the direction of the preference 
is available, a two-sided test is used. 

2.18 Variance — The quotient obtained by dividing the sum of squares of 
deviations of the observations from their mean by one less than the number 
of observations in the sample. 

2.19 Standard Deviation — It is the positive square root of variance. 

2.20 Standard Error ( 5E) — Standard deviation of an estimator, the 
standard error provides an estimate of the random part of the error involved 
in estimating a population parameter from a sample. 

2.21 Statistic — A function of observed values derived from the sample. 

3. SYMBOLS 

3.1 Following symbols have been used for expression of sensory evaluation 
results; 

N : number of items in the population, 
n : number of samples/sample pairs^ 
m : number of panelists, 

k : number of preferences into which the sample is classified, 
52 : summation, 
I 1 : absolute value, 
Xi : measurement on fth item, 
p : proportion of observations possessing a given attribute, and 

^ _ Xi+X2+...+Xm 

m 

4. DIFFERENCE/PREFERENCE TESTS 

4.1 These tests involve separately or jointly detection of differences or 
preferences or both regarding organoleptic attributes of two products. It 
is necessary to know from the start whether a particular test is one-sided 
( one direction is of particular interest ) or a two-sided ( both direction^ are 
of equal interest ). For example, in two samples of orange squash one with 
14 percent sugar and another with 16 percent sugar, if the test is required 
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to be done 16 identify the sweeter sample, a one-sided test has to be used. 
On the other hand, for testing of two market brands of a cola beverage, if 
the test is required to be conducted to decide which of the two is sweeter, 
a two-sided test has to be used. 

4.2 The various statistical tests used for analysing the data arising from 
sensory evaluation experiments are covered in 4.7 to 4J2. The selection of 
the appropriate test shall depend upon the objective of an experiment, the 
strength of the measurement, the type of panel used and number of samples 
to be evaluated. 

4.3 In addition to statistical considerations mentioned with respective 
methods of analysis, psychological errors which may be committed by a 
panelist have also to be kept in view. These errors may be committed due 
to his previous knowledge of the test samples or their method of presenta- 
tion, tendency to repeat previous impressions, reluctance to use extreme 
values on a scale specially for unfamiliar foods, tendency to rate the adja- 
cent quality factors similar as in the case of simultaneous scoring of colour 
texture, odour, taste and general acceptability on the same set of samples, 
and tendency to continue to give the same response when a series of slowly 
increasing or decreasing stimuli are presented. 

4.4 The minimum number of panelists for these tests shall be seven. 
However, depending upon the purpose of the experiment and type of panel, 
this number shall be sufiBciently larger. For general guidance regarding the 
number of panelists, IS : 6273 ( Part II ) - 1971* may be referred. 

4.5 In the presentation of test samples, the following precautions shall be 
taken: 

a) Provision shall be made for sufficient quantity of bulk sample which 
can be divided into the necessary number of individual samples; 

b) It shall not be possible for the panelists to draw conclusions as to 
the nature of samples from the way in which they are presented. 
The various pairs of the scries shall be prepared in an identical 
fashion ( same apparatus, vessel and quantities of products ); 

c) The temperature of the samples in any given pair ^hall be the same 
and if possible, shall be same as that of all other samples in a given 
test series; and 

d) The vessels containing the test samples shall be suitably coded and 
coding shall be different for each test. 

4.6 If *no difference' or 'no preference' replies have been permitted, ignore 
them, that is subtract them from the total number of replies received. 



♦Guide for sensory evaluation of foods: Part II Methods and evaluation cards. 
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4.6.1 A large proportion of *no difference' or *no preference' replies could 
indicate, in particular, that the diflFerence between the samples is below the 
detection threshold of the panelists. This may equally reveal an imperfect 
experimentation technique, reflect the existence of an important physiologi- 
cal variation in the panelists or even the lack of motivation of certain 
panelists for the tests in which they are participating. 

4.7 Paired Comparison Test — It may be used for the following purposes: 

a) Directional Differences — In order to determine the direction of 
differences between two test samples for a specified attribute, for 
example, more or less sweet; and 

b) Preference — In order to establish whether there is a preference 
between two test samples, for example, in consumer tests. 

4.7.1 Paired samples shall be presented simultaneously or successively for 
evaluation. The order of presentation shall he balanced so that the combi- 
nations AB and BA appear an equal number of times and are distributed at 
random among the panelists. Several pairs may be offered in succession 
( series of pairs ), provided that sensory fatigue is minimized or avoided. 

4.7.2 The manner in which the questions are asked is very important as it 
may lead to bias in the replies of the panelists. Depending on the aim of 
the test, the following questions may be asked: 

a) Test for directional difference — Of these two samples, which is the 
more ? (sweet, salty, etc); and 

b) Test for preference — Of these two samples, which do you prefer? 

4.7.3 The total number of correct responses for a one-sided test and the 
total number of predominant responses ( that is, the larger of the two 
figures ) for a two-sided test shall be compared with the corresponding values 
given in Table 1 for determining whether there is a significant difference 
between samples or a significant preference for one of them. 

4J A Example 1 — A paired comparison test was conducted with two 
samples of orange squash, one of them being known to have better aroma; the 
panelists were asked to make a judgement, as to which of the samples had 
a stronger aroma. Twenty panelists participated in the evaluation, out of 
which 17 concurring judgements of detection of difference were recorded. 
It is clearly a one-sided test and referring to Table 1, 16 concurring judge- 
ments are the minimum required for significance at one percent level. The 
null hypothesis that there is no difference is thus rejected, 

4.7.5 Example 2 — A preference test was run with 35 nursery school 
children on two i?a/a/?^r samples; formulation ^ contained corn, soya and 
skim milk; and formulation B contained wheat, groundnut, and Bengal gram 
flours. 26 children preferred formulation A and the remaining preferred 
the formulation B. It is required to test whether any significant preference is 

8 
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there for one of the formulations. It is clearly a two-sided test as either 
sample can be preferred with equal chance. Referring to Table 1 for two- 
sided test, 26 concurring judgements are required for significance at 1 per- 
cent level. Hence formulation A is preferred to B at 1 percent level. 

4.8 Duo-Trio-Test — The samples are presented in groups of three, one of 
them labelled as i? ( reference ) and the other two coded. One of the coded 
samples is identical with R and the other is different. The panelists will be 
given the reference sample first and fhen other two coded samples. They 
will be asked to pick out the sample in the coded pair matching with the 
reference sample. For testing the significance, Table 1 shall be referred, 

4*%A Example 5 — A duo-trio test was conducted with two samples of 
grape juice, one prepared with 0'3 percent lactic acid and the other with 0"4 
percent lactic acid, the former being the reference sample. 25 panelists parti- 
cipated in the evaluation, out of which 11 could identify the sample match- 
ing with reference sample correctly. The test is clearly one-sided test as the 
panelists are required to identify the sample matching with the reference 
sample. Referring to Table 1, 18 concurring judgements are necessary to 
establish significance at 5 percent level. Hence, it can be concluded that the 
difference between the two levels of lactic acid is not perceptible. 

4.9 Triangle Test — The coded samples are presented to each panelist in 
groups of three. The panelists are given the information that two of the 
samples are identical. The identification of the odd sample is required. For 
-testing significance. Table 2 may be referred. 

4.9.1 Example 4 — A triangle test with two meat sausages, one with normal 
salt and the other with extra salt was conducted, the latter being given as 
the odd sample. Out of 20 panelists, 15 correctly identified the odd sample. 
It is a one-sided test. Referring to Table 2, it may be noted that 14 correct 
judgements are required for significance at O'l percent level. Hence, it is 
concluded that the two sausages are significantly different from one another. 

4.10 T^ormal Test for Proportions — This test is used to test the significance 
of difference between observed and expected proportions. Any preference 
data with more than 30 panelists obtained by paired comparisons can be 
analysed by this method, 

4.10.1 The u statistic to be computed for this test is obtained as: 

,, ^ \p - Po l 
SE{^) 

where p ~ observed proportion, 

Pq = expected proportion, and 

SE{ ) = I ^ ~ -^0 ) » w being the total number of 
V m panelists. 
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4.10.2 Foratwo-sidedtest, the computed value of « is compared with the 
critical value of 1*96 at 5 percent, 2' 58 at 1 percent and 3'29 at 0*1 percent 
levels of significance. For a one-sided test, the critical values at 5 percent, 
1 percent and 0*1 percent levels of significance are 1*64, 2'33 and 3 '09 
respectively. The null hypothesis of the equivalence of observed and expec- 
ted proportion is rejected, if the computed value of u exceeds the corres- 
ponding critical value at the chosen level of significance. 

4.10.3 Example 5 — A preference test was run between samples A and B 
with 121 panelists. The sample A was preferred by 72 panelists and sample 
B by 49. It is required to test whether the preferences for samples A and 
B are significantly different. 

In this example, the null hypothesis is that the preferences for samples A 
and B are same against the alternate hypothesis that they are different. Thus 
it is clearly a case of a two-sided test. The u statistic is computed as below: 

72 
Observed proportion (p ) = -j^T " ^'^^^ 

Expected proportion ( Po ) = i = 0'500 

5£(p)=/^IS^ = 0-045 



121 
Hence 



0-595 - J0-50o f ..„ 
" -0^045 =211 

As the computed value of w is greater than r96, the preferences for two 
samples A and B are found to be different at 5 percent level of significance. 

4.11 Preference Matrix Analysis — This method is essentially an extension 
of paired preference test to more than two samples and the selection of a 
subset of samples just large enough to ensure with a pre-assigned proba- 
bility that the most preferred sample is included in the subset. 

4.11.1 The paired preference test is conducted on all possible pairs and 
results are tabulated in a matrix as shown below: 

Preferred Not Preferred Sample Total 



&am 


pie 1 

Ai Ai Ai 




Ax 


f{AuA2) f(AuAi) . 


.. f(AuAn) fUl) 


Az 


fiA2,A:) ... fiA2,A3) . 


.. /(^2,^n) fiAi) 


A3 


f{A3,Ai) f{A3,A2) 


.. f{A3,An) f{Ai) 



An f{An,Ai) f(An,A2) f(.An,Ai) /(^„) 

.10 
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In the matrix, /( >4i, Ai ) indicates the frequency of preference of Ai over 
Ai in the pair ( Au A\ ) where i ^/ The number of panelists participating in 
the test is given by / ( Ai, A\ ) -[-/( ^j, Ai ), where i #7. 

The last column ( total ) represents the total preference for each sample. 
A subset containing the most preferred sample can be identified in the 
following manner. 

The sample with maximum total preference is selected first. The tabulated 
value corresponding to a given number of panelists participating and num- 
ber of samples is read from Table 3A at 5 percent level of significance or 
from Table 3B at 1 percent level of significance. If/ denotes the maximum 
total preference and f denotes the tabulated value, all the samples which 
have frequencies in the range of {f—t') to/ are taken as forming the 
required subset. 

4.11.2 Example 6 — Paired comparison tests are conducted for 4 formula- 
tions of cola beverages and the data so collected is analysed by using a pre- 
ference matrix. 100 panelists familiar with cola beverages participated in the 
test. The following preference matrix is obtained; 

Total 



Preferred 




Not Preferred Formulations 




Forniulations 






_i 






A 


B 




C 


D 


A 


— 


90 




80 


50 


B 


10 


— 




50 


20 


C 


20 


50 




— 


40 


D 


50 


80 




60 


— 



220 

80 

110 

190 

It is required to select a subset of samples just large enough to ensure 
with a 99 percent probability that the most preferred formulation is included 
in the subset. 

The formulation A with 220 as maximum total preference is first selected. 
In order to identify the required subset, the tabulated value at 1 percent 
level of significance from Table 3B corresponding to 100 panelists and 4 
samples is 38. All the formulations which have the total frequencies in the 
range of 182 ( — 220 — 38 ) to 220 are taken as forming the required subset. 
In this case only formulations A and D can be included in the subset. 

4.12 x^-Test — This is a useful test for testing goodness of fit and indepen- 
dence of attributes with respect to some characteristic. As it holds good for 
large sample size, the total number of panelists participating in an experi- 
ment should be sufficiently large ( say not less than 50 ) and each expected 
cell frequency shall not be less than 5. If any expected cell frequency is le^s 
than 5, appropriate classes may be combined. 

11 
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4.12.1 Goodness of Fit — The problem that frequently arises in sensory eva- 
luation of foods is the testing of the compatibility of a set of observed and 
expected number of panelists having preference for various samples includ- 
ed in a particular experiment. In such cases the null hypothesis is that the 
preferences for various samples are same against the alternate hypothesis 
that they are different. 

4.12.1.1 Data arising from paired comparison test can also be analysed 
by using this test. As ready tables are available for paired comparison test, 
this test may be used for the situations where the number of panelists 
included in an experiment exceeds the number of panelists covered in 
Table 1. It is particularly useful whenever more than two samples are to be 
compared. It may be noted that even by normal test given in 4.01 only two 
samples can be compared. 

4.12.1.2 If there are n samples ( 1, 2, 3, ..., w ) to be compared and Oi, 02, 
..., On are the observed number of panelists preferring the samp]esl,2, ...,n 

n 

respectively so that 52 ot is the total number of panelists participating 

in the experiment, it may be of interest to know whether these ob- 
served frequencies differ significantly from those which could be expected 
for these samples on the basis of the null hypothesis that preferences for 
various samples are same. In this case if we denote the expected number of 
panelists preferring the samples 1, 2, ..., n by ^i, ^2, -.., en respectively so 

n n 

that Yii Oi— Y\ eu the test statistic to be used is: 
/-I i^i 

X^ = S ~^ — T"^' ^^^^ ( rt— 1 ) degrees of freedom or less, depending on 

whether the expected cell frequencies computed from the data are required 
to be combined. 

4.12.1.3 A small value x^ is associated with good agreement between 
observed and expected frequencies, whereas a large value tends to indicate 
the discrepancy. Whether the discrepancy is likely to arise by; chance, is 
decided by reference to Table 4. 

4.12.1.4 If the calculated value of x^ is greater than or equal to the 
tabulated value given in Table 4, the null hypothesis that observed and 
expected number of panelists prefering various samples is same, is rejected 
at a specified level of significance. In other words preferences for various 
samples are found to be different at that level of significance. 

4.12.1.5 Example 7 — In a preference test on three samples of candy A, 
B and C with 150 panelists, 60 chose A, 50 chose B and 40 chose C It is 
required to determine whether the preferences for candies A, B and C are 
significantly different. 

12 
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Here the null hypothesis is that the preferences for samples A, B and C 
are same. Thus the expected nuilaber of panelists preferring each of the 
three samples A^ B and C is 50. The value of x* in this case is 

2 v^ (oi-ei)^ _ (60-50)3 , (50-50)3 , (40-50)^ 
X3== g^ j^ 50 + 50—+ 50—^^^ 

with 2 ( = 3 - 1 ) degrees of freedom. 

The tabulated value of x^ fto^^ Table 4 for 2 degrees of freedom is 5*99 
at 5 percent level of significance. As the computed value of x^ is less than 
the tabulated value, there is not enough evidence to reject the null hypo- 
thesis meaning thereby that the preferences for candies A, B and C are not 
different at 5 percent level of significance. 

4«12.2 Independence in Contingency Tables — When a set of observations 
are tai?ulated according to two variables in n rows and k columns, a two 
way table is obtained with nx k cells. Such two way tables are also called 
contingency tables. It is required to test whether the two classifications are 
independent, that is the probability that an observation falls in a particular 
row ( column ) is not affected by the particular column ( row ) to which it 
belongs. 

4.12.2.1 If there are n types of a product ( number of samples ), each 
' of which is classified into k preferences, the number of panelists indicating a 
particular preference shall constitute the observed frequency for that cell. 
Here the null hypothesis is that the number of panelists showing a certain 
preference is independent of types of samples and preferences into which 
each of the samples is classified. Hence the expected frequency for a cell is 
obtained by dividing the product of corresponding row and column totals 
by overall total. 

4*12.2.2 If 01 J and eij represent the observed and expected frequencies 
respectively in the nk cells of the contingency table, ejj's under the null 
hypothesis can be obtained with the help of marginal totals and the overall 
total Thus ei\, that is, the expected number of jpanelists classifying the /th 
sample into/th preference is obtained by dividing the product of marginal 
totals of fth row and yth column by the overall total. The test statistic is 
then calculated as: 

with (72"-l)x(/c-l) degrees of freedom. 

4.12.2.3 Example 8 — Three groups of 50, 100 and 150 school children 
respectively, each selected at random from a school were given protein chewy 
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candies flavoured with rose, vanilla-cocoa and almond for classifying into 
three categories as excellent, good and just acceptable. Each group was 
given protein chew candies flavoured differently. The data obtained is given 
in the following two-way table: 

Number of School Children Preferences 
Type Observed {Expected) Total 



Rose 

Vanilla-cocoa 

Almond 


Excellent 

28(238) 
45 ( 47-7 ) 
70(71-5) 


Good 

18(18-0) 
40(36-0) 
50(54-0) 


Just Acceptable 

4(8-2) 50 
15 ( 16'3 ) 100 
30 ( 24-5 ) 150 



Total 143 108 49 300 

It is intended to test whether the relative preferences of the children for 
the three types of candies are same, which then forms the null hypothesis. 

If the number of school children showing a certain preference is independ- 
ent of types and preferences, the expected frequency for rose type with 
excellent preference is calculated as 50 X 143/300 = 23'8. The expected 
frequencies for various combinations of types and preferences are given in 
brackets. The x^ - statistic is then calculated as: 

(28- 23-8 y ( 30 - 24-5 )^ _ .... 

23*8 "^ ' "^ 24-5 ^^^ 

Since this value is less than the tabulated value of 9'49 [5 percent value 
of x^-distribution given in Table 4 corresponding to(3 — 1)(3 — 1) = 4 
degrees of freedom], we do not have enough evidence to doubt the null 
hypothesis that the preferences of children for three types of candies are 
not significantly diflferent. 
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TABLE 1 PAIRED COMPARISON AND DUO-TRIO TESTS 

( Clauses 4.73,4 J A, 4.7.5, 4.8 V?/wf 4.12.1.1 ) 



Number of 


Minimum CoNCURttiNO Judge- 


Minimum Concurring Judge- 


Judgements 


MENTS FOR ONE-SiDED TEST 


ments 


FOR Two-SiDED Test 




POR 


Probability Level 


K»R 


Probability Level 






.Jl. 






A 






/ 




■ -""'" — ^ 


t 




"^ 




0*05 


001 


0-001 


005 


0*01 


0-001 


(1) 


(2) 


(3) 


(4) 


(5> 


(6) 


(7) 


1 


7 


7 





7 


«. 


— 


% 


7 


8 


— 


8 


8 


— 


9 


8 


9 


~^ 


8 


9 


— 


to 


9 


10 


10 


9 


10 


— 


11 


9 


10 


11 


10 


11 


11 


12 


10 


li 


12 


10 


11 


12 


13 


10 


12 


13 


11 


12 


13 


14 


11 


12 


13 


12 


13 


14 


15 


12 


13 


14 


12 


13 


14 


16 


12 


14 


15 


13 


14 


15 


17 


13 


14 


16 


13 


15 


16 


18 


13 


15 


16 


14 


15 


17 


19 


14 


15 


17 


15 


16 


17 


20 


15 


16 


18 


15 


17 


18 


21 


15 


17 


18 


16 


17 


19 


22 


16 


17 


19 


17 


18 


19 


23 


16 


18 


20 


17 


19 


20 


24 


17 


19 


20 


18 


19 


21 


25 


18 


19 


21 


18 


20 


21 


30 


20 


22 


24 


21 


23 


25 


35 


.23 


25 


27 


24 


26 


28 


40 


26 


28 


31 


27 


29 


31 


45 


29 


31 


34 


30 


32 


34 


50 


32 


34 


37 


33 


35 


37 


60 


37 


40 


43 


39 


41 


44 


70 


43 


46 


49 


44 


47 


50 


$0 


48 


51 


55 


50 


52 


56 


90 


54 


57 


61 


55 


58 


61 


100 


59 


63 


66 


61 


64 


67 
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TABLE 2 TRIANGLE TEST 










(C/flM^ej 4.9 aK^ 4.9.1) 






Number of 


Minimum Concurring Judge- 


Minimum Concurring Judge- 


Judgements 


ments FOR One-Sided Test 


ments FOR Two-Sided Test 




FOR 


Probability Level 


FOR 


Probability Level 




__^__^^____ 


A 






j^ 




r 






-» 


( 


-'"^ 


— > 




005 


001 


0-001 


005 


001 


0-001 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


1 


— 


— 


— 


— 


— 


^ 


2 


— 


— 


— 


™ 


— 


— 


3 


3 


— 


— 


— 


— 


— 


4 


4 


— 


— 


— 


— 


■ 


5 


4 


5 


— 


' — 








6 


5 


6 


— 


— 








7 


5 


6 


7 


5 


6 


7 


8 


6 


7 


8 


6 


7 


8 


9 


6 


7 


8 


6 


7 


8 


10 


7 


8 


9 


7 


8 


9 


11 


7 


8 


10 


7 


8 


9 


12 


8 


9 


10 


8 


9 


10 


13 


8 


9 


11 


8 


9 


10 


14 


9 


10 


11 


9 


10 


11 


15 


9 


10 


12 


9 


10 


12 


16 


9 


11 


12 


10 


11 


12 


n 


10 


11 


13 


10 


11 


13 


18 


10 


12 


13 


10 


12 


13 


19 


11 


13 


14 


11 


12 


14 


20 


11 


13 


14 


11 


13 


14 


21 


12 


13 


15 


12 


13 


15 


22 


12 


14 


15 


12 


14 


15 


23 


12 


14 


16 


13 


14 


16 


24 


13 


15 


16 


13 


14 


16 


25 


13 


15 


17 


13 


15 


17 


30 


15 


17 


19 


16 


17 


19 


35 


17 


19 


22 


18 


19 


21 


40 


19 


21 


24 


20 


22 


24 


45 


21 


24 


26 


22 


24 


26 


50 


23 


26 


26 


24 


26 


28 


60 


27 


30 


33 


28 


30 


33 


70 


31 


34 


37 


32 


34 


37 


80 


35 


38 


41 


IS 


38 


41 


90 


30 


45 


45 


39 


42 


45 


100 


42 


46 


49 


43 


46 


49 
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TABLE 3A CRITICAL VALUES FOR PRES^ERENCE MATRIX 
ANALYSIS AT 5 PERCENT LEVEL 



{ Clause 4.11.1 ) 



Samples 



Panelists 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 

IJ 
12 
13 
14 
^5 
16 
17 
18 
19 
20 

25 
30 
35 
40 
45 
50 



1 
2 
3 
4 
3 
4 
5 
4 
5 
6 



2 
3 
4 
5 

5 
6 
6 

7 
7 
7 



3 
4 
5 
6 
6 
7 
8 
8 
9 
9 



3 

5 

6 

7 

8 

8 

9 

10 

10 

11 



4 
5 
7 
8 
9 
9 
10 
11 
12 
12 



4 

6 

7 

9 

10 

10 

11 

12 

13 

14 



5 
7 
8 
9 
10 
11 
12 
13 
14 
15 



5 
7 
9 
10 
11 
12 
13 
14 
15 
16 



10 



5 
8 
9 
11 
12 
13 
14 
15 
16 
17 



5 


8 


10 


11 


13 


14 


16 


17 


18 


6 


8 


10 


12 


13 


15 


16 


17 


19 


5 


8 


11 


12 


14 


15 


17 


18 


19 


6 


9 


11 


13 


14 


16 


18 


19 


20 


7 


9 


U 


13 


15 


17 


18 


20 


21 


6 


9 


12 


14 


15 


17 


19 


20 


22 


7 


10 


12 


14 


16 


18 


19 


21 


22 


6 


10 


12 


14 


16 


18 


20 


21 


23 


7 


10 


13 


15 


17 


19 


20 


22 


24 


8 


10 


13 


15 


17 


19 


21 


23 


24 


9 


12 


15 


17 


19 


21 


23 


25 


27 


8 


13 


16 


19 


21 


23 


26 


28 


30 


9 


14 


17 


20 


23 


25 


28 


30 


32 


10 


15 


18 


22 


24 


27 


30 


32 


34 


11 


16 


20 


23 


26 


29 


31 


34 


36 


12 


17 


21 


24 


27 


30 


33 


36 


38 



60 


12 


18 


23 


26 


30 


33 


36 


39 


42 


70 


14 


20 


24 


29 


32 


36 


39 


42 


45 


SO 


14 


21 


26 


31 


35 


38 


42 


45 


48 


90 


16 


22 


28 


32 


37 


41 


44 


48 


51 


100 


16 


23 


29 


34 


39 


43 


47 


51 


54 



17 



IS : 6273 ( Part Ill/Sec 1 ) - 1983 



TABLE 3B CRITICAL VALUES FOR PREFERENCE MATRIX 
ANALYSIS AT 1 PERCENT LEVEL 

(C/^«^e 4.11.1) 



\ Samples 




















\. 


2 


3 


4 


5 


6 


7 


8 


9 


10 


PanelistsX 




















1 


1 


2 


3 


4 


4 


5 


6 


6 


7 


2 


2 


4 


5 


6 


7 


8 


8 


9 


9 


3 


3 


5 


6 


8 


9 


9 


10 


11 


12 


4 


4 


6 


7 


9 


10 


11 


12 


13 


13 


5 


5 


7 


8 


10 


U 


12 


13 


14 


15 


6 


6 


7 


9 


11 


12 


13 


14 


15 


16 


7 


5 


8 


10 


12 


13 


14 


16 


17 


18 


8 


6 


9 


11 


12 


14 


15 


17 


18 


19 


9 


7 


9 


11 


13 


15 


16 


18 


19 


20 


10 


8 


10 


12 


14 


16 


17 


19 


20 


21 


11 


7 


10 


13 


15 


16 


18 


19 


21 


22 


12 


8 


11 


13 


15 


17 


19 


20 


22 


23 


13 


9 


11 


14 


16 


18 


19 


21 


23 


24 


14 


8 


12 


14 


16 


18 


20 


22 


24 


25 


15 


9 


12 


15 


17 


19 


21 


23 


24 


26 


16 


10 


12 


15 


18 


20 


22 


23 


25 


27 


17 


9 


13 


16 


18 


20 


22 


24 


26 


28 


18 


10 


13 


16 


19 


21 


23 


25 


27 


28 


19 


9 


14 


17 


19 


21 


24 


26 


27 


29 


20 


10 


14 


17 


20 


11 


24 


26 


28 


30 


25 


11 


16 


19 


22 


25 


27 


29 


31 


34 


30 


12 


17 


21 


24 


27 


30 


32 


34 


37 


35 


13 


19 


22 


26 


29 


32 


35 


37 


40 


40 


14 


20 


24 


28 


31 


34 


37 


40 


42 


45 


15 


21 


25 


29 


33 


36 


39 


42 


45 


50 


16 


22 


27 


31 


35 


38 


41 


45 


47 


60 


18 


24 


29 


34 


38 


42 


45 


49 


52 


70 


20 


26 


32 


37 


41. 


45 


49 


53 


56 


80 


20 


28 


34 


39 


44 


48 


52 


56 


60 


90 


22 


30 


36 


42 


47 


51 


56 


60 


64 


100 


24 


31 


38 


44 


49 


54 


59 


63 


67 



18 



IS t 6273 (Part lU/Sec 1 ) - 1983 



TABLE 4 CRITICAL VALUES OF X*- DISTRIBUTION 

( Clauses 4.12.1.3 anJ 4A2AA ) 
Degrees of Freedom Significance Level 



1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
28 
29 
30 



0-05 


001 


0-001 


3-84 


6-64 


10-83 


5-99 


921 


13*82 


7-82 


11-34 


16-27 


9.49 


13-28 


18-46 


1107 


15*09 


20-52 


12-59 


16-81 


22-46 


1407 


18-48 


23-32 


15-51 


20*09 


26-12 


I6'92 


21-67 


27-88 


18*31 


23-21 


29-59 


19-68 


24-73 


31-26 


21-03 


26-22 


32-91 


22-36 


27*69 


34-53 


23-69 


29-14 


36-12 


25-00 


30-58 


37-70 


26-30 


32-00 


39-25 


27-59 


33-41 


40-79 


28-87 


34*81 


42-31 


30-14 


36-19 


43-82 


31-41 


37-57 


45-32 


32-67 


38-93 


46-80 


33-92 


40-29 


48-27 


35-17 


41-64 


49-73 


36-42 


42-98 


51-18 


37r65 


44-31 


52-62 


38-89 


45-64 


54-05 


40-11 


46-96 


55-48 


41-34 


48*28 


56-89 


42-56 


49-59 


58*30 


43-77 


50-89 


59-70 
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INTERNATIONAL SYSTEM OF UNITS ( S( UNITS ) 



Ba$e UnitB 




UtiBnifiy 


Unfl 


L^sngth 


metro 


Mass 


kHogram 


Tim? 


sscond 


Electric curfernt 


^mper^ 


T-h^r rno d y nan l-ic 


kelvih 


tcmporatiiFQ 




Lumin&us intsmfiilv 


CFinriela 


AmDtir>t^f substance 


molo 


Supplementary Unit^ 




Q<i&ntitY 


Umt 


Pi and angle 


radian 


£i!k]id drigle 


etcjradr^n 


D«r(ved Unit* 




Qi^^nlltV 


Unf( 


Fofce 


Tfe&wltin 


Energy 


JflUl* 


Pnw&r 


W3II 


rjux 


r w$b?.r 


Flux densrty 


t4^.0;? 


Fri^qitjcncy 


hartz 


Electric conducla-nce 


sremerifi 


El&ttromotfve- fo-rce 


vult 


Pr^issyr^ stress 


pascal 



m 
kg 

9 

A 
K 

cd 

mof 



Syfnhnf 

tad. 



Symbol 

H 
J 
W 

T 
H« 

S 

V 
Pa 



D«fhitiott 

^ H = 1 kgrn/s' 

1 J = 1 ISf,m 

1 W = 1 j;s 
1 Wb - 1 V.3 
1 T :^ 1 Wt>;m* 

1 Hi! = 1 c;* <a-'^) 
1 S ■= 1 A.'V 

1 V " 1 WjA 
1 Pa ^ 1 N/m* 
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